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Abstract 

Let F be a p-adic field, and G„ one of the groups GL(n, F), GSO(2n — l, F), GSp(2n,F), 
or GSO(2(n— 1), F). Using the mirabolic subgroup or analogues of it, and related "derivative" 
functors, we give an asymptotic expansion of functions in the Whittaker model of generic 
representations of G„ , with respect to a minimal set of characters of subgroups of the maximal 
torus. Denoting by Z n the center of G„, and by N n the unipotent radical of its standard 
Borel subgroup, we characterize generic representations occurring in L 2 (Z n N„\G n ) in terms 
of these characters. 

This is related to a conjecture of Lapid and Mao for general split groups, asserting that the 
generic representations occurring in L 2 (Z n N n \G„) are the generic discrete series; we prove 
it for the group G n - 

Introduction 

Let G n be the points of one of the groups GL(n), GSO(2n-l), GSp(2n), or GSO(2(n- 1)) over 
a p-adic field K. The main result (Theorem l2.1[) of this work describes the asymptotic behaviour 
of the restriction of Whittaker functions to the standard maximal torus, in terms of a family of 
characters which is minimal in some sense. From results of |L-M| . this restriction can be described 
for split reductive groups in terms of cuspidal exponents. 

Here, after having defined analogues of the mirabolic subgroup for the groups G ni and the corre- 
sponding derivative functors, following |C-P| (where the case of completely reducible derivatives 
is treated for GL(n)), we choose to describe the restriction of Whittaker functions to the torus 
in terms of central exponents of the derivatives. 

This description, inspired by [B], is better adapted to understanding when the Whittaker model 
of a unitary generic representation is a subspace of L 2 (Z n N n \G n ) (these representations are con- 
jectured to be generic discrete series by Lapid and Mao). 

In the first section, we review the groups in question and define their mirabolic subgroups. We 
also give a decomposition of the unipotent radical of the standard Borel subgroup, and a descrip- 
tion of how nondegenerate characters of this radical behave with respect to this decomposition. 
In Section 2, we give properties of the derivative functors, and use them to prove our asymptotic 
expansion of Whittaker functions, which is Theorem l2.il 

In Section 3, we characterize generic representations with Whittaker model included in L 2 (Z n N n \G n ) 
in terms of central exponents of the derivatives, in Corollary 13. II We then prove in Theorem 13.21 
the conjecture 3.5 of |L-M| . 

After the writing of this paper, Patrick Delorme informed us that he obtained the proof of the 
conjecture of Lapid and Mao in the general case (Theorem 8 of |D2| ). 

*Nadir Matringe, University of East Anglia, School of Mathematics, Norwich, UK, NR4 7TJ. Email: 
n.matringe@uea.ac.uk 
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1 Mirabolic subgroup and nondegenerate characters 



Let F be nonarchimedean local field, we denote by Df its ring of integer, and by typ — ^pOp 
the maximal ideal of this ring, where wp is a uniformiser of F. 

We give a list of groups, and describe some of their properties which will be used in the sequel: 

• Case A: 

The group Go is trivial, and for n > 1, the group G n is GL(n,F). 

We consider the maximal torus of G„ consisting of diagonal matrices, it is isomorphic to 
(F*) n . 

For n > 2, the simple roots of this group can be chosen to be the characters 

a t {diag(xi,. . .,x n )) = x l x^ 1 

for i between 1 and n — 1 . 

The root subgroup U ai is given by matrices of the form I n + xEi^ + \ for x in F. 

Standard Levi subgroups of G n are given by matrices of the form diag(a\, . . . , a r ) where a, 

belongs to GL{rn, F), with m H \-n r = n. We denote the preceding group by M( ni) ... )Tlr ), 

and the corresponding standard parabolic subgroup is denoted by P( nii ... )Tlr ), with unipo- 
tent radical Ur ni<m ..,„,.)• 

For n > 2 we denote by /7„ the group f/( n _i,i), of matrices of the form 
It is isomorphic to 

For n > fc > 1, the group Gfc embeds naturally in G„, and is given by matrices of the form 

diag(g,I n -k)\ we denote by Zk its center. 

We denote by P n the mirabolic subgroup G n _i k C/„. 

• Case B: 

The group Go is trivial. 

For n > 2, the group G„ = GO(2n — 1, F) is the group of matrices g in GL(2n — 1, F) such 
that *5Jg belongs to F* J. We call the multiplier of an element g in G„ the scalar fx(g) such 
that 'gJ<7 is equal to fi(g)J (one checks that for this group, the multiplier actually belongs 
to (F*) 2 ), where J is the antidiagonal matrix of GL(2n — 1,F) with ones on the second 
diagonal. It is the direct product of SO(2n— 1, F) with F* , more precisely, of SO(2n— 1, F) 
and the group I(F*) of matrices I(t) = tl 2n -i for t in F*. 

The maximal torus of G„ is equal to the product of the torus of matrices of the form 
diag(x~_ 1 , . . . , x^ 1 , 1, x\, . . . , x n -\) with I(F*) and is isomorphic to (F*) n . 
For n > 3, the simple roots of this group can be chosen to be the characters 

a i+1 (diag(tx~\, . . . ,tx^,t,tx\, . . .,tx n -\)) = XiX^ 

for i between 1 and n — 2, and a^diag^x^^, . . . , tej^ 1 , t, tx\, . . . , tx n -i)) = x^ 1 . 
The root subgroups U ai are given by matrices of the form 

diag(u, . . . , 1, u, 1, . . . , 1, u^ 1 , 1, . . . , 1) 

for matrices u in the unipotent radical of the Borel of GL{2, F). 



In- 
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For n > k > 1, the group Gk embeds naturally in G„, and is given by matrices of the form 

diag(fj,(g)Ik, g, I n -k), where fi(g) is the multiplier of the element g of Gk- 

Its center Zk is given by matrices of the form Zk{t) = diag(t 2 I n -k, ^ik-x^n-k) f° r t m K*. 



For n > 1 , the standard Levi subgroups of G n are given by matrices of the form 

diag(iJ,(g) T a~\, . . . , n^Ya^ 1 , g , a\, . . . ,a r ), 

where Oj belongs to GL(n i} F). T a is the transpose of a with respect to the second diagonal, 

g belongs to G m , with 2m — 1 + 2m H h 2ra r = 2n — 1. We denote the preceding group by 

M( TO;ni; ... j7 i r ), and the corresponding standard parabolic subgroup consisting of block upper 
triangular matrices is denoted by P(m;m,...,n r )i with unipotent radical U( m . ni ^ nr y 



For n > 2 we denote by [/„ the group t/( n _i ; i), of matrices of the form 
It is isomorphic to F 2n ~ 3 . 



1 _*y -"W/2' 

/2n-3 V 
1 



For n > 2, we denote by P n the "mirabolic" subgroup G n -i k [/„. 
• Case C: 

The group Go is trivial, the group G\ is F*. 

For n > 2, the group G„ = GS , p(2(n - where GSp(2(n - 1),F) is the group of 

matrices g in GL(2(n — 1),F) such that *gJ5 belongs to F*J, where J ■ 



W 
-W 



and 



W is the antidiagonal matrix of GL(n — 1,F) with ones on the second diagonal. It is the 
semi-direct product of Sp(2(n — 1),F) with F*. more precisely, of Sp(2n, F) and the group 
I(F*) of matrices I(t) = diag(tI n -\, I n -i) for t in F*. 



The maximal torus of G„ is equal to the product of the torus of matrices of the form 
diag(x~_ 1 , . . . , , xi, . . . , x n -i) with I(F*) and is isomorphic to (F*) n . 
The simple roots of this group are the characters ai+i(diag(tx~^_ 1 , . . . , tx^ , x\, . . . , x n -\)) = 
XiX± +1 for i between 1 and n — 2, and ai(dia5(te~_ 1; . . . jta;^ ,xi, . . . ,x„_i)) = tx^ 2 . 
For i less than n, the root subgroup U ai is given by matrices of the form 

dia0(l,...,l,u,l,...,l,u _1 ,l,...,l), 

for matrices u in the unipotent radical of the Borel of GL(2,F), whereas U an is given by 
matrices diag(l, . . . , 1, u, 1, . . . , 1), for matrices u in the unipotent radical of the Borel of 
GL(2,F). 



For n > k > 2, the group Gfc embeds naturally in G„, and is given by matrices of the form 
diag(/j,(g)I n -k, g, I n -k), where n{g) is the multiplier of the element g of Gk- Its center Zk 
is given by matrices of the form Zk(t) — diag(t 2 I n ^k, tl 2 (k-i) > In-k) f° r t in F*. The group 
Gi, which is equal to its center Z\, embeds as I(F*). 



For n > 1, the standard Levi subgroups of G„ are: 
— either matrices 

diag{n{g) T a,-\, . . . , ^(gYa^ 1 , g,a x , . . .,a r ), 

where a, belongs to GL(m, F), g belongs to G m with m > 2, with 2(m — 1) + 2ni + 
■ ■ ■ + 2n r = 2(n — 1). We denote the preceding group by Mr m . ni ^ ^ n \, and the corre- 
sponding standard parabolic subgroup consisting of block upper triangular matrices is 
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denoted by P( m ;n 1 ,...,n r )i with unipotent radical J/( m; m,...,n r )- 
— or the matrices 

z\.diag{a~\, . . . , a^ 1 , ai, . . . , a r ), 
with aj in GL(rii, F), 2ri\ + • • • + 2n r = 2(n — 1), and zi in Gi. 

Forn > 2, we denote by f/„ the group f/( n _i ; i), of matrices of the form 



i -Wi T^i x' 

/n-2 Vi 
/n-2 ^2 
1 



For n > 3, it is an extension of F 2 ^ n 2 ) by F, which is the Heisenberg group corresponding to 
the alternating bilinear form on F 2 ( n " 2 ), given by (W u W 2 ) x (Vi, V 2 ) i— > -W 2 .Vi + T VFi.F 2 . 
It is a two steps nilpotent subgroup, with center equal to its derived subgroup, given by 
matrices with V\ = V 2 = 0, and the maximal abelian quotient U® b of U n is F 2 ("~ 2 ) . 
The group C/ 2 is the unipotent radical of the standard Borel of Gi = GSp{2 1 F) = GL(2, F), 
and is isomorphic to (F, +). 

For n > 2, we denote by P n the "mirabolic" subgroup G n ~i x U n . 
• Case D: 

We denote by Go the trivial group. The group Gi is F*. 

For n > 2, the group G„ = GSO(2(n — 1),F) is the group of matrices g in GL(2n,F) 
satisfying that l gJg belongs to F*J, where J is the antidiagonal matrix of GL(2n, F) with 
ones an the second diagonal. It is the semi-direct product of SO(2(n — 1), F) with the group 
I(F*), of the matrices J(i) = diag(tl n , I n ) for t in F*. 

The maximal torus of G„ is equal to the product of the torus of matrices of the form 
diag(x~_ 1 , . . . , x\, . . . , x n -i) with I(F*) and is isomorphic to (F*) n . 
If n is 2, then G 2 is the diagonal torus of GL(2,F). 

For n > 3, the simple roots of this group can be chosen to be the characters 

a i+ i(diag(tx~\, . . .,tx~ 1 ,xi, . . . ,ar„_i)) = XiX~^ 

for i between 1 and n — 2, and a^diag^x" 1 , . . . , te^ 1 , xi, . . . , x„)) = tx^ 1 ^^ 1 . 
For « > 1, the root subgroup f/ ai+1 is given by matrices of the form 

diag(l,...,l,u, 1, . . . , l,tt _1 , 1, . . . , 1) 

for matrices u in the unipotent radical of the Borel of GL(2,F), whereas U ai is given by 

"1 V 



matrices diag(l, . . . , 1, u, 1, . . . , 1) for matrices w of the form 



1 -v 

1 

1 



with y in F. 



For n > k > 2. the group Gk embeds naturally in G„, and is given by matrices of the form 
diag(fi(g)I n -k, g, I n -k), where n(g) is the multiplier of the element g of Gk- For k > 3, its 
center Zk is given by matrices of the form Zk(t) — c?iag(t 2 /„_fc, i/ 2 (fc-i) j In-k) for t in F*. 
We denote by Z 2 the subgroup of the torus G 2 , given by matrices of the form 
z 2 (t) = diag(tl n 2 , 1, t, I n 2) for t in F*. 
The group Gi which is equal to its center Z\, embeds as I(F*). 

The standard Levi subgroups of G„ are the following: 
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— The groups given by matrices of the form 

diaginigya' 1 , . . . , nigYa^ 1 ,g, a 1 , . . . , a r ), 

where a% belongs to GL(rii, F), g belongs to G m with m > 3, with 2(m — 1) + 2n\ + 
■ ■ ■ + 2n r = 2(n — 1). We denote the preceding group by M( m;m ,..., nr ), and the cor- 
responding standard parabolic subgroup is denoted by P( m ;n 1 ....,n r )i with unipotent 
radical U (m . ni ..... nT ). 

— The groups given by matrices of the form 

g 2 .diag( T a~ 1 , . . . ? a{ \ 1, 1, Oi, . . . , a r ), 

with at in GL(n i} F), 2n\ + ■ ■ ■ + 2n r = 2(n — 2), and g 2 in G 2 . 

— The groups given by matrices of the form 

z 1 .diag( T a~ 1 7 . . . /of 1 , Oi, . . . , a r ), 

with aj in GL(rii, F), 2ri\ + • • • + 2n r = 2(n — 1), and z\ in Gi. 

— The groups given by matrices of the form 

z 2 .diag( T a~ 1 , . . . , T a^,g,ai, . . .,a r ), 

where a, belongs to GL(n i} F) 7 and g in GL(2(m — 1), F) is of the form 

A V 

t' V 
L t 

V A' 



A V 
L t 



G GL(m - 1, F), 



with 



A a, (m — 2 x m — 2)-matrix, 



with 2m + 2ri\ + • • • + 2n r = 2n and z 2 in Z 2 . 
For n > 3 we denote by [/„ the subgroup f/( n _i ; i) of G„, of matrices of the form 





T L'~ 




'A 


V 


-l 




t' 




L 


t 





1 



-TV 

h(n-2) 



-W/2' 
V 
1 



It is isomorphic to f 2 ™ 2 . 



For n > 3 denote by P n the "mirabolic" subgroup G„_i k U n . 
We denote by U 2 the group and by P 2 the group Gi k ?7 2 - 

Lemma 1.1. VFe denote by Zi the center of Gi, except in case D when n = 2, where we denote 
by Z 2 the subgroup diag(l,t) with t in F* of G 2 . In all cases, one checks that the maximal torus 
A n of G n is the direct product Z\.Z 2 . . . Z n _\.Z n , and each Zi is isomorphic to F* . Moreover, 
the i-th root has the property that cti{z\ . . . z n ) = Zi, in other words these coordinates parametrize 
the torus A n such that simple roots become canonical projections. 



5 



The unipotent radical N n+ i of the standard Borel subgroup of G n +i is equal to U2 ■ ■ ■ U n +±. 
Let 9 be a nondegenerate character of N n +i (i.e. that restricts non trivially to any of the simple 
root subgroups). We denote by 6i+i the character Oijj. , except in the case D, for i = 2. In this 
case U3 — U ai x U a2 , and we denote by 63 the character 0a(u ai u a2 ) = 9(u a2 ). 
Because 9 is trivial on Uder, and according to the description of Uder in Theorem 4.1 of [B-HJ, 
the character must be trivial on every root subgroup U a contained in C/;+i such that a is 
not simple, moreover for case D, n = 2, the character 63 is trivial on U ai . 

Conversely, if a non trivial character 9i + \ of Ui+i is trivial on every U a C J/j+i which is not simple, 
and if, in case D, n = 2, we impose in addition that 63 is trivial on U ail then one checks that the 
normalize!' of Oi+i in the mirabolic subgroup Pj+i is Pjf/i+i. As the group U% . . . Ui is a subgroup 
of a family of non trivial characters 9i + \ of Uj+i, trivial on every J7 Q C J7j+i except U ai , 
defines a nondegenerate character of N n+ i =U%. . . J7 n +i by #(u2 . . . u n+ i) = Jl"=i 

Now we fix such a nondegenerate character 9, and write 9 k for the character #2 ■ ■ • 9k of iVfc . 



2 Derivatives and Whittaker functions 

If G is an ^-group, we denote by Alg(G) the category of smooth complex G-modules. If (it, V) 
belongs to Alg(G), H is a closed subgroup of G, and \ is a character of H, we denote by V(JT, x) 
the subspace of V generated by vectors of the form ir(h)v — x{h)v for h in H and i> in V. This 
space is actually stable under the action of the subgroup No(x) °f the normalizer Na(H) of H 
in G, which fixes %. 

We denote by 8h the positive character of Nq (H) such that if fj, is a right Haar measure on G, and 
A is the left translation of smooth functions with compact support on G, then /xoA(n _1 ) = <5^(n)/x 
for n in N. 

This gives the spaces V(H,x) and Vh iX = V/V{H,x) (that we simply denote by Vh when x is 
trivial) a structure of smooth iV(3(x)-modules. 

Notations being as in the first section, and for fc be an integer between 2 and n we define the 
following functors: 

• First we recall the definition of the Jacquet functors: 

Let P be a parabolic subgroup of G„, with Levi subgroup M, and unipotent radical U. 
We denote by Jp the functor from Alg(G n ) to Alg(M) such that, if (tt, V) is a smooth 
G ra -module, we have Jp(V) = Vjj, and M acts on Jp(T^) by Jpir(m)(v + V(U, 1)) = 
5 c/ (m)- 1 /2 7r ( TO ) l , + y([/,l). 

• With the same notations, we denote by ip the functor from Aig(M) to Alg(G n ) such that, 
if p is a smooth M-module, and p is the corresponding P-module obtained by inflation of 
p to P, then ip(/o) is the G„-module zndp' l (p) where ind is the usual compact induction. 

• The functor (denoted ru k .e k in section 1 of |B-Z.2| ) from Alg(Pk) to Alg(Pk-i) such 
that, if (7T, V) is a smooth P^-module, $~ y = Vu k ,e k , and Pfe_i acts on $7(F) by 

• The functor $g" (denoted i^^s. in section 1 of |B-Z.2| ) from Alg(Pk-i) to Alg(Pk) such 

that, for 7r in Alg(Pk-i), one has 3>g" 7T = indp h v (5y tt ® ^fe), where ind is the usual 
compact induction. 

• The functor (Iu k ,e k in section 1 of [B-Z.2] ) from Alg(Pk-i) to Alg(Pk) such that, for tt 
in AZt^Pfc^i), one has tt — Indfp iV {5\j 2 ir ® 9k), where Ind is the usual induction. 
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• The functor if? is the Jacquet functor Jjj k , (denoted ru k ,i in section 1 of |B-Z.2|) from 
Alg(P k ) to Alg(Gk-i), such that if (n, V) is a smooth P^-module, ^?~V — Vu k ,i, and G k -i 
acts on V-(y) by 9-*{g)(v) + V(U k , 6 k ) = S Uh (g)- 1 ' 2 *^ + V(U k , 1)). 

• The functor *f? + (denoted ijj k ,i m section 1 of [B-Z.2J) from Alg(G k -i) to Alg(P k ), such 

— X / 2 X / 2 

that for 7r in one has \I> + 7r = ind G k k _ iUk (5 l j k tt ® 1) = <Jj/ 7r <g> 1. 

As we already fixed the character # of iV n , we will most of the time forget the dependence in 
Ok of $>0 k and 3>g" , and we will write these functors $~ and $ + . These functors have the following 
properties which follow (except for c) an d) which are trivial) from Proposition 1.9 of |B-Z.2j : 

Proposition 2.1. a) The functors $ + , , J , ~, and *f? + are exact, 
b) \fr~ is left adjoint to *+. 
6 $ is ie/t adjoint to 
cj = 

dj = Zd. 

Now we want to know how these functors restrict to smooth P^-modules which are submodules 
of the space C°° (N k \P k , 9 k ) — I n d P f k {9 k ) of functions on P k , fixed by some open subgroup of Pk 
under right translation, and which transform by 9 k under left translation by elements of N k . 
The next proposition shows the stability of this type of modules under $~ and <J> + . 

Proposition 2.2. For any submodule r of C°° (N k \P k , 9 k ) , the P k _\-module $~r is a submodule 
of C°°(N k —i\P k —i, 9 k ~ 1 ), with model given by restriction of functions S Uk ^ 2 W in t to P k -\, and 
such that we have *f?~T(p)W — p(p)W for p in P k -i, where p is the action by right translation. 
Conversely, the P k +i-module $ + t can be identified with a submodule of C°°(N k+ \\P k+ i, 9 k+1 ), 
with the natural action of P k +i by right translation. 

Proof. The first property will hold if we show that C cc (N k \P k ,9 k )(U k ,9 k ) is the kernel of the 
restriction map to C°°(Nk-i\P k -i, 9 l ), this is a straightforward adaptation of the proof of 
Proposition 2.1 of [CTP] . 

The second property is a consequence of the following equalities and inclusions: 

$+(C°°(N k \P k ,6 k )) = ind^ k+i (Sy k 2 +i .IndP k (9 k ) g k+l ) 
C Jnd££ +1 (4f +i Jndfr k (9 k ) ® 9 k+1 ) ' 

Then 

8]j k \jnd p N \{6 k )~Ind% h {6 k ) 

1 /2 

because the character 5 T ( of P k is trivial on N k . 
Finally 

Ind^JInd^) ® 9 k+1 ) ~ Ind P N k k + + \(9 k+1 ) 

□ 

More can be said about smooth P^-submodules of the space C°° (N k \P k , 9 k ) — Ind^f {9 k ). If 
r is a Pfc-submodule of C°° (N k \P k , 9 k ), then the derived subgroup of U k (which is trivial except 
in case D) acts trivially. 

To see this, take W in C°° (N k \P k , 9 k ), we claim that if u belongs to the derived subgroup U c k ler 
of U k , then t(u)W and W are equal. So let p belong to P k ; one has t(u)W(p) = W(pu) = 
W(pup^ 1 p) = 9 k (pup~ 1 )W(p). But P k normalizes U k (so 9 k (pup~ 1 ) — 9 k (pup~ 1 )), so that it 
normalizes its derived subgroup as well; as 9 k is trivial on this subgroup, this proves our claim. 

For such modules pj-modules, there is a nice interpretation of V(U k , 1) in terms of the ana- 
lytic behaviour of Whittaker functions. First, we make the following observation. 
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Remark 2.1. For k > 3, as a consequence of the Iwasawa decomposition, any element g of Gk-i 
can be written in the form pzc with p in Pk-i, z in Zk-\, and fc in K = Gt-i(Dj? ), and the 
absolute value of z depends only on g, so we can write it \z(g)\p. 

If a function W is in the space of C°°(Nk\Pk, 9 k ), then for g in Gk-i, we show that W^g) vanishes 
whenever \z(g)\p is large enough. 

Indeed if we take the "natural" group isomorphism u from (F m ,+) to U^ b , for some positive 
integer to, and recalling that it is in fact U^ b that acts on V, then u(x) will fix W for x near zero 
in F m . 

But then, for g in Gfc_i of the form pzk, one has W^g) = W(gu(x)) = 9k{gu(x)g^ 1 )W(g), 
which is equal 9k(zku(x)(cz)~ 1 )W (g) because Pfc_i normalizes 6k- This implies the equality 
\9k(zku{x)(kz)~ 1 ) — l]W(g) = [6k(u(zkx)) — l]W(g) — for any a; in a neighbourhood of zero 
depending only on W. The assertion follows easily. 

Proposition 2.3. Let (t,V) be a P k -submodule of C oc (N k \Pk,9 k ). Then the space V(Uk,l) is 
the subspace ofV, of functions W such that there exists an integer Nyy with W(g) = 0, for any 
g satisfying \z(g)\ F < qp Nw . 

Proof. Suppose first that a function W is in V(Uk, 1), so we can write it tt(u)W' — W for some 
u in U£ b and some W' in V. Then, writing g as pzk, and u as u(x) for x in F m , we have 
[ir(u)W — W'](g) = [8k(u(zkx)) — l]W'(g), which will be zero to when \z\p is close to zero. 
Conversely, we use the characterization of Jacquet and Langlands asserting that the elements W 
of V(Uk, 1) = V(U% , 1) are those such that r(u)Wdu is zero as soon as the open compact 
subgroup U of 11% contains some compact open subgroup Uw- So suppose W is in V and that 
it vanishes on elements g of G n -\{F) satisfying |z(<7)|^ < q~^ Nw . 

Let U be any open compact subgroup of U^ b , that we identify with a subgroup of F m . The 
integral Jjj r(u)Wdu evaluated at g — pzk, is equal to J xeU 9k(zkx)W(g)dx. Hence this integral 
is always zero for \z\f < Qp Nw because W(g) is. 

We now recall that as Ok is a non trivial character of U^ b , there exists a compact open ball Uo of 
jjab ^ pn suc jj that, the integral J xeU 9k(x)dx is zero whenever the compact open subgroup U 
of U^ b contains Uq. But then for \z\p > qp Nw , if tw is an element of F* of absolute value qp w , 
the integral J xeU 6k(zkx)W(g)dx is also zero as soon as U contains t\yUo- Hence J v r(u)Wdu 
is zero when U is a compact open subgroup of U£ b containing Uw — tyyUo, and W belongs to 
V(U k ,l). 

□ 

For any smooth P„-module r, and any integer k > 1, we denote by tvm the representation of 
Pn-k+i equal to $ fc_1 r, and by the representation of G n _fc equal to \l/^$ fc_1 T = \t~T(M. 
We say that a smooth irreducible representation ir of G n is ^"-generic if it is isomorphic to a 
submodule of the induced representation Ind^"(7r). If it is the case, the submodule of Indf/ 1 ^) 
isomorphic to it is unique, it is called the Whittaker model of 7r and denoted by W(tt, 9 n ). 
Now we let (ir, V) be a ^"-generic representation of G n (hence a smooth P n -module as well), we 
denote by (jr',V) the representation of P n obtained on the space of restrictions of functions in 
W(tt, 9) to P n , it is a quotient of 7r as a P„-module, and restriction to P n is known to be an 
isomorphism in case A. 

The following proposition follows from applying repeatedly Proposition 12.21 and from Propo- 
sition 12.31 

Proposition 2.4. Let t be a smooth P n -submodule of C°°(N n \P n ,9 n ), and k > be an integer, 
then the Pk+i-module Ti n —f-—i) * s a submodule of C°°(Nk+i\Pk+i,9 k+1 ), with model given by re- 
striction of functions [Sjj k+2 ■ ■ ■ ^t/ n ] _1 ' 2 W in t to Pk+i- In this realisation, one has T( n -k-i) (p)W — 
p(p)W for p in Pk+i, where p is the action by right translation. 
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The next proposition asserts amongst other things that for every k > 1, the G n _fc-module 
tt^ has finite length. 

Proposition 2.5. If (n, V) is a smooth representation of G n of finite length, then for k between 
1 and n — 1, the G k -module 7r("~ fc ) (hence its quotient 7r'( n_fe ) ) has finite length. 

Proof. For k > 1, except in case D, k = 2, we denote by Uk, n -k the unique standard unipotent 
radical (denoted by U^ n _ k ^ in the previous section) containing U ak as only simple root subgroup. 
In case D, for k = 2, we be denote U2, n -2 the unique standard unipotent radical containing U ai 
and U a2 as only simple root subgroups. 

In all cases, the corresponding Levi Mk, n -k is the direct product of G k with GL(n — k,F). 
Now the module G^-module Tr( n ~ k '> is a quotient of the Jacquet Gk X GL(n — fc)-module 

(nu h , n ^,V/V(U k , n . k ,l)), 

as the kernel of the surjective map n -» ^ n ^ k ^ contains V(U k ^ n - k , !)• More precisely, let N n -k.A 
be the unipotent radical of the standard Borel subgroup of GL(n — k, F), the group Uk+i • ■ - U n 
is the semidirect product N n -k,A x U k , n - k , so that the space V^ n ~ k ^ of 7r^™ _fc - ) is equal to the 
quotient 

,n— fej $| N n - k _4 

where V is the space of it. 

We denote by I k the surjection obtained by facorisation from Vu k „_ k onto V^ n ~ k \ From Lemma 
2.32 of |B-Z| . the map I k identifies with the projection 

v u k , n - k -» (^7 k , n _ fe )jv n _ fe , A ,ep JVn _ fe ^ = Vu k ^-k/ v u kin -k( N n-k,A,0" Nri _ k A ). 

The map is in fact a Gfc-modules morphism, because of the equality of modulus characters 

( S U k , n _ k )\G k = ($u k+1 ■■■$u n )\G k 
which is itself a consequence of the decomposition 

n 

u k , n -k = ]J ( u k,n-k n Ui). 

i= k +l 

The group NA, n - k being a union of compact subgroups, the map I k preserves exact sequences. 
As the Jacquet module functor preserves finite length, the G k x GL(n — k, F)-modu\e ■Kjj k n _ k 

has a finite composition series C (j^u k „_ fc )i C • • • C (j^u k „~ k )r k — ^u k „_ fc < We put 7r| n k ^ — 
h[{^u k ^ k )i}- 

Hence 7r^ n_fe) /ir^® is equal to [(^u k:n . k )i/(^U k:n . k )i-i]N n - k , A ,8 INn _ k A , but as a G k x GL(n - 
fc, i^)-module, the quotient {"Ku k n -h)i/(' JT Uk „_ fc )i-i isomorphic to p\ ® pi for irreducible represen- 
tations pi and p2 of Gfe and GL(n—k, F) respectively. Because the character 8 n restricts to N n ^ k ,A 
as a nondegenerate character, the quotient Trj" ^V 71 "!-! fc '* is equal to pi<E)(p2)N n - k a-S^ n , thus 
it is zero unless p2 is generic, in which case it is equal to the irreducible representation p\. 
So we proved that 7r( n_fc ) has finite length as G^-module, smaller than the length of the Jacquet 
module iru k „_ fe as a G k x GL(n — k, F)-module. 

□ 

There is another property of the maps I k defined in the proof of the preceding proposition 
that is worth mentioning, which is that their restriction to generalised characteristic subspaces is 
nonzero. More formally, let G be an Z-group, and T be a closed abelian subgroup of G. If V is a 
smooth G- module, following [C] , we define for each character % of T, the T-submodule 

V x ,oo = {veV\3ne N, Vt 6 T, ( r (t) - x(t)M)"(«) = 0}. 
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If V is T-finite (i.e. every vector in V generates a finite dimensional T-module), then it is the 
finite direct sum of its (nonzero by definition) generalised characteristic subspaces, and every such 
(nonzero) V Xj00 contains the nonzero generalised eigenspace 

V x = {v £ V\ 3n eN.yte T, (r(i) - x(i)Id)(v) = 0}. 

First recall that smooth (F*) r -modules E, with a filtration = Eq C E\ C • • • C E r _x C 
E r = E such that (F*Y acts by a character on each quotient are (F*) T '-finite. 

Lemma 2.1. Le£ E be a smooth (F*) r -module E, with a filtration = Eq C -Ei C • • • C -EV-1 C 
= £ suc/i that (F*Y acis &y a character Cj+i on eac/i quotient Ei + \/Ei, then any vector of E 
lies in a finite dimensional (F*) r -submodule. 

Proof. One proves this by induction on the smallest i such that Ei contains v. If this i is 1, the 
group (F*Y only multiplies v by a scalar, and we are done. 

Suppose that the result is known for Ei, and take v in but not in Ei. Then for every t in 
(F)*, the vector r(t)v — Ci + i(t)v belongs to Ei. By smoothness, the set {t(u)v \t £ (UfY} is 
actually equal to {t(u)v \u £ P} for P a finite set of (UfY ■ The vector space generated by this 
set is stabilized by (UfY, an d has a finite basis V\, . . . , v m . Now the vectors 

T(l, . . . , 1,ZU F , 1, ■ ■ ■ , ~ C i+ l(l, . . . , 1,H7F, 1, ■ ■ ■ , l)vi 

belong to Ei, hence by induction hypothesis, to a finite dimensional (F*) r -submodule Vi of E^. 

Finally the finite dimensional space Vect(v±, . . . , v m ) + V\ H h V m is stable under (UfY an d 

the elements (1, . . . , 1, wf, 1, . . . , 1), hence (F*Y ', and contains u. □ 

This in particular applies to the ZkZ n -modvle Vjj k „_ fc and the Z^-module V described in the 
proof of Proposition 12.51 as both are respectively Gk x GL(n — k,F) and Gfc-modules of finite 
length. 

Now we can prove the following property of the maps Ik : 

Proposition 2.6. Let (tt, V) be a 6 n -generic representation of G n , and for k > 1, let Uk, n -k md 
Mk,n—k — Gk x GL(n — k, F) the subgroups of G n defined in the proof of Proposition^^ Let x be a 
character of the central subgroup ZkZ n of Mk, n —k> an d denote by the same letter its restriction to 
the central subgroup Zk of Gk- If the generalised characteristic subspace (Vu k „_ fe )x,oo *s nonzero, 
then the map Ik restricts non trivially to (Vjj k „_ fe )x- ^ n particular the space V^ n fe ' is nonzero. 

Proof. Suppose that the subspace (Vu h „„ fc ) x .oo of Vu k „_ fc is nonzero, hence (Vu k n - k )x ^ s nonzero. 
The space (Vjj k n _ k )x IS Affe in _fe-submodule of Vjj k n _ h , so it has finite length, hence it contains 
some irreducible representation pi®p2 of Mk, n -k- Hence HomM k „_ fe (pi®Pi, Vu k is nonzero, 
but then from Bernstein's second adjointness theorem (see [BuJ, Theorem 3), we deduce that V 
is a quotient of the representation p\ x p2 parabolically induced from p\ ® p2- As V" admits a 
nonzero Whittaker form, so does p\ x p2, and from a classical result of Rodier (Theorem 7 of 
[R]). this implies that pi and p2 are generic with respect to some nondegenrate character. As 
generiticity doesn't depend on the character for GL(n — k,F), we deuce that Ik(pi <S> P2) = Pi- 
Hence Ik restricts non trivially to (Vu k „_ fc )xi an d the image Ik[(Vu k n _ k )x] contains p\ which is 
a nonzero submodule of V^ n fe ' . □ 

We will also need to know that, if k is an integer between 1 and n—1 and x is a character of Zk, 
then the Z fc -modules (V<- n -V) x and (V'^-^Y are nonzero at the same time. We already know 
from the previous proposition that this is equivalent to the fact that the ^-modules (V'( n ~ k ^) x 
and (Vjj k „_ fc )x are nonzero at the same time, and that (V'( n ~ k )) x nonzero implies that (Vu k „_ fc )x 
is nonzero. 
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Proposition 2.7. If (jr,V) is a 6 n -generic representation ofG n , and for k > I, let Uk, n —k and 
Mk,n—k — Gk x GL(n — k,F) be the subgroups of G n defined in the proof of Proposition 
Let x be a character of the central subgroup Z k Z n of M k . n _ k , and denote by the same letter its 
restriction to the central subgroup Z k of Gk, then the space (Vu h „_ fc )x * s nonzero if and only if 
the space (V'( n ~ k ^) x is nonzero. 

Proof. We only need to prove that if (Vu k n _ k ) x is nonzero, then the space (y( n_fe ') x is nonzero. 
So suppose that the Mfc^^-module (Vu k n _ k ) x is nonzero, it is of finite length, hence it contains an 
irreducible Mfc jn _fc-submodule p. Call P ktTl - k the parabolic subgroup M k ^ n ^ k U k . n ~ k , and P kn _ k 
its opposite parabolic subgroup (with unipotent radical (U k ^ n - k )~). We already saw that by 
Bernstein's second adjointness theorem, the induced representation z^" (p) has ir as a quotient, 

and therefore z^" (p) is ^"-generic. Then from Theorem 7 of [R], the Mfe jn _fe-module p is 0- 

generic, where 9 is the restriction of 6 n to the unipotent radical of the Borel of M k _ n - k . Both have 
the same Whittaker model W(ir, 8 n ), i.e. the (unique up to scalar) Whittaker form on the space of 
ip_ (p) facorises through the projection from iffl (p) to 7r. Let be a nonzero 9- Whittaker 

form on the space of p, by Theorems 1.4 and 1.6 of |C-S| . there is a nonzero Whittaker form L on 
the space of r" (p) whose restriction to the subspace C£°(P kn _ k \P kn _ k U kin - kl {S v - ) 1 ^ 2 p) of 

™k,n-k ' ' k 

functions with support in P kn _ k U k ^ n - k is given by 

/>-»• / L-{f{u))e- l (u)du. 

JUk, n -k 

We denote by L the Whittaker form on the space of 7r which lifts to L. In particular, for any / 
in the space of n, which is the image of / in '(Pj~ n _ k \P k n _ k Uk,n-k) , one has 

L(f) = / L-{f(u))6-\u)du. 

JUk, n -k 

Let v be a vector in the space of p, such that L~(v) is nonzero. Let K' be a compact subgroup of 
G n , with Iwahori decomposition with respect to P ktU - k , and such that K' n M k , n -k fixes v, then 
the function a equal to u~mu H ► p(m)v on (U k ^ n - k )~ Mk, n -k(Uk. n —k H K'), and zero outside, 
is well defined and belongs to the space C^°(P kn _ k \P kn _ k U k , n - k ,p). We denote by W a the 
corresponding Whittaker function g H> L(iv(g)a). If a belongs to the group Z k , one has 

W a (a) = / L~(a(tia))0 -1 (u)du 

= x(«)< / „ 2 ,(«) / L-iaia-'ua^^du 

JUk, n -k 

= xi a )5\j k _ k {a) J L~ (a(u))0 -1 (aua~ 1 )du 

= x(a)S 1 u / k _ k {a)L-(v) [ fl _1 (aua -1 )du 

In this last integral, u stays in the compact set U k _ n ~ k PI if, hence there is a (punctured) 
neighbourhood of zero in Lie(Z k ) = F, such that a{Uk, n -k n l£"')a _1 is a subset of Ker(0) when 
a belongs to this neighbourhood. Finally, up to multiplication of the function a by a scalar, one 
has 

W a (a) = X (a)S 1 u / k 2 nk (a)L-(v) 

whenever a is this neighbourhood of zero. 
A similar computation gives the equality 

W a (zg) = x(z)S Ukn _ k (z) 1 / 2 c g 
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for z in in a neighbourhood of zero and g in Gk, where c g is the constant J ( 
Hence from Propositions 



u k , n - k L (a(ug))du. 

and the equality (S Ukn _ k )\ Gk = (S Uk+1 . . -5 Un )\ Gk , we deduce 
1 ^ 2 W a in the space of n', n _ k+1 \ is such that its image in ir'( n ~ k } 



that the vector (5. 

is nonzero and belongs to the space (7r' tTl_fe, ) x . This proves the proposition. 



□ 



A straightforward generalisation of the proof of the preceding proposition gives the following 
corollary. 

Corollary 2.1. Let G be the F-points of a quasi-split reductive group defined over F. Let P be a 
parabolic subgroup of G with a Levi subgroup M, and P~ its opposite subgroup with PnP~ = M. 
Let (tt, V) be a smooth 9 -generic representation of G, for some nondegenerate character 9 of the 
unipotent radical U of a Borel subgroup of G contained in P. We denote by j P - be the map 
defined in Theorem 3.4 of JTJ^ from {V*) Ue to ( Jp(V)*) MnUe . If L is a nonzero vector of the 
line (V*) Ue , then the linear form jp-(L) restricts non trivially to any irreducible M-submodule 
of Jp(V) whenever the Jacquet module Jp(V) is nonzero. 

We now come back to the study of F*-modules E with finite factor series such that F* acts by 
a character on each quotient. From Lemma 12.11 any vector of E will belong to a finite dimensional 
F*-submodule E' as in: 

Proposition 2.8. If E' is a non zero finite dimensional F* -submodule of E, then E' has a basis 
B in which the action of F*r is given by a block diagonal matrix MatpiTit)) with each block of 
the form: 

(c{t) c(t)P l!2 (v F (t)) c(t)P h3 (v F {t)) ... c{t)P hq (v F (t)) \ 
c(t) c(t)P 2t3 (v F (t)) ... c{t)P 2 , q (v F (t)) 



V 



c(t) c(t)P q - liq (v F (t)) 
c(t) J 



for c one of the Ci 's, q a positive integer depending on the block, and the P^j 's being polynomials 
with no constant term of degree at most j — i. 

Proof. First we decompose E' as a direct sum under the action of the compact abelian group Up. 
Because E 1 has a filtration by the spaces E 1 n Ei , and that F* acts on each sub factor as one of 
the Cj's, the group U F acts on each weight space as the restriction of one of the Cj's. Now each 
weight space is stable under F* by commutativity, and so we can restrict ourselves to the case 
where E' is a weight-space of Up. 

Again E' has a filtration, such that F* acts on each sub factor as one of the c$ 's (with all these 



characters having the same restriction to Up), say c^, . 



. , in particular, we deduce that the 



endomorphism t{w f ) has a triangular matrix in a basis adapted to this filtration, with eigenvalues 
Cjj (vjp), . . . ,Ci k (vj f ). As t(w f ) is trigonalisable, the space E' is the direct sum its characteristic 
subspaces, and again these characteristic subspaces are stable under F*. 

So finally one can assume that E' is a characteristic subspace for some eigenvalue c(ir) of t(zu f ), 
on which Up acts as the character c, where c is one of the c,-'s. 



Hence there is a basis B of E' such that 



McrfB(c _1 (X)T(i)) 



(I Ai j2 (t) A h3 (t) 
1 A 2t3 (t) 



V 



•• A hq (t)\ 
... A 2 , q (t) 

1 A q - hq (t) 
1 J 



for any t in F*, where the Aij's are smooth functions on F*. So we only have to prove that the 
Aij's are polynomials of the valuation of F with no constant term. 
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We do this by induction on q. 

It is obvious when q = 1. Suppose the statement holds for q — 1, and suppose that E' is of dimen- 
sion q, with basis B = (vi, . . . ,v q ). Considering the two c~ 1 r(i 7 '*)-modules Vect(vi, . . . ,v q -i) 
and Vect(v\, . . . , v q ) /Vect(vi) of dimension q — 1, we deduce that for every couple (i, j) different 
from (1,9), there is a polynomial with no constant term Pij of degree at most j — i, such that 
Aij = Pij ovp. Now because c _1 r is a representation of F*, and because the Pi j ovp^s vanish on 
Uf for 7^ (1,3), we deduce that A\, q is a smooth morphism from (Uf, x ) to (C, +), which 
must be zero because (C, +) has no nontrivial compact subgroups. From this we deduce that Ai^ q 
is invariant under translation by elements of Up (i.e. A\ !q (zupu) = Ai, q (zu F ) for every U in Uf)- 
Denote by M(k) the matrix Mat B (c^ 1 T(w F )) for k in Z. One has M(k) = M(l)M(k - 1) 
for k > 1, which in implies Ai^(tu^) = E|=2 p ij( 1 )- P 7,?( fc ~ X ) + ^i^^f" 1 ) + = 
Q(k) + Ai^wp^ 1 ) + Ai^(wf) for Q a polynomial of degree at most q — 2. This in turn implies 
that Ai yq (w F ) = QQ) + kA\ tq (vjF) — R(k) for R a polynomial of degree at most q — 1, 

according to the theory of Bernoulli polynomials, for any k > 0. The same reasoning for k < 0, 
implies Ai :q (w F ) = R'(k) for R' a polynomial of degree at most q—1, for any k < 0. We need 
to show that R = R' to conclude. 

We know that M(fc) is a matrix whose coefficients are polynomials in k for k > of degree at 
most g — 1, we denote it by P{k). The matrix M(k) has the same property for k < 0, we denote 
it by P'(k). Moreover for any k > and fc' < 0, with k + k' > 0, one has P(fc + k') = P(k)P'(k'). 
Fix k > q — 1, then the matrices P(fc + k 1 ) and P(k)P' {k 1 ) are equal for fc' in [1 — q,0], as their 
coefficients are polynomials in k 1 with degree at most q — 1, the equality P(k + z') — P(k)P' {z') 
holds for any complex number z' . Now fix such a complex number z' , the equality P(fc + z') 
and P(k)P' [z') holds for any integer k > q — 1, and as both matrices have coefficients which are 
polynomials in k, this equality actually holds for any complex number z, so that P(z + z') equals 
P(z)P'(z') for any complex numbers z and z' . 

As P(0) ~ I q , we deduce that P and P' are equal on C, and this implies that R is equal to R' . □ 

From this we deduce the following theorem, giving an expansion at infinity of Whittaker 
functions of generic representations of G n , for GL(n), the statement holds for ant smooth P n - 
submodule of finite length of C°°(N n \P n ): 

Theorem 2.1. Let 9 be a nondegenerate character of the group N n , let ir be a 9-generic repre- 
sentation of G n , and let ci jn _fe, . . . , c rk . n -k be the characters of Zk appearing in a composition 
series of r = 7r ( -™ _fe - ) . Then, for any function W in the space of it , the function 

W(zi, z 2 , z n -i) = W{zxz 2 , —z n -i) 

is a linear combination of functions of the form 

n-l 

h k , k S^ +i . . . 6%](z h )v F (z k r>><t> k (*k) 

fc=i 

for ik between 1 and positive integers rrik, and functions cj)k in C£°(F). 

Proof. Actually we prove the following stronger statement, which is satisfied by 7T( ) according to 
Proposition 12.51 

. Let 7r be a submodule ofC°°(N n \P n ,9), such that for every k between 1 andn~l, the Gk-module 
t = 7r < -"~ fe ) = , i ,- ( < I > ~)™~ fe ~ 1 (7r) has a composition series such that on each respective quotient, 
the central subgroup Zk acts by the characters ci jn _fc, . . . ,c rk . n -k- 

Then, for any function W in the space of it, the function W{z\, z 2 , = W{z\Z 2 , ...z n — 1) 
is a linear combination of functions of the form 

n— 1 

II I c ^.fe (5 c/{ 2 +1 ■ ■■S 1 u ^}{z k )v F {z k ) mk M z k) 
fc=l 

for ik between 1 and r k , positive integers rrik, and functions ipk in C^°(P). 
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The proof is by induction on n. 
Let W belong to the space of tt. We denote by v its image in the space E of . The vector v 
belongs to a finite dimensional Z„_i-submodule E' of E, on which Z n _\ acts by a matrix of the 
form determined in Proposition ^. 81 We fix a basis B = (ei, . . . , e q ) of E', and denote by M(a) the 
matrix Mb{t(o)) (with a in Z n _\ and r(a) = n^(a)), hence we have r(a)e/ = 2l=i M(a) k je k 
for each Z between 1 and 

Taking preimages E\, . . . ,E q of ei, . . . , e q in 7T( ), we denote by E the function vector : 

\E q ; 

If the image v of in is equal to xiei + • • • + x q e q , there is an integer M, such that for 
every (z\, . . . , z„_2) in Zi x • • • x Z n -2, the function 

. . . ,z„_i) - (xi, . . . ,x q )E(zi, . . . ,z n -i) 

vanishes for |z„_i|j? < qp M . We denote by S the function {x\, . . . ,x q )E. 

Because of Remark 12.11 there is an integer M', such that for any (zi, . . . , z n -2) in Zi x ■ ■ ■ x 
Z n -2, and any z„_i in Z n -\ of absolute value greater than , both W(zi, . . . , z n -i) and 
S^zi, . . . , z„_i) are zero, so that the difference D{z\ 1 . . . , z„_i) of the two functions is a smooth 
function which vanishes whenever z n -\ has absolute value outside [qp M ,qp ! ]. Moreover there 
is a compact subgroup U of Z„_i(Di?) independent of {z\, . . . , z„_i) such that both functions 
(hence D) are invariant when z n _i is multiplied by an element of U . Denoting by (z a ) a e a a 
finite set of representatives for 

k F M <k-l|F<#'W, 

this implies that D(zi, . . . , z„-i) is equal to £ ^ -D(^i) • • • 1 Zn—2, z a )l Za u(z n —i)-, which we 
can always write as J2 a G a d ( z i> ■ ■ ■ > z "-2, -Za)^ 2 (z„_i)D a (z n _i) with D Q = (5y 1/2 l ZaC / in 
C7~(Lie(Z„_i)). 

Each function D(zi, . . . , z„_2, z Q ) is equal to W{zi, . . . , z a ) — S{z\, . . . , z Q ), and the restrictions to 

— 1/2 

P n -i of the functions 8 V [ir{z a )D] belong to the smooth submodule $~ (n) of C°°(iV„_i\P n _i, 0), 
which still satisfies the hypothesis of the statement. 

Hence, by induction hypothesis, the function D is a sum of functions of the form 

J] [c ik , k 5]j* +i . . . 5y*]{z k )v F {z k r'^' k (z k ) 
fc=l 

for i k between 1 and r kl null or positive integers or integer vectors m' kl and functions <j)' k in 
C?{He{Z k )). 

Now, call p the projection W' i-> (<5^/ 2 W^')|p„-i fr° m ^(o) to 7rW, then for any a in one 
has p{a)p{Ei) = '}2 l q k=1 M{a) k jp{E k ). Hence as p(a)p(Ei) equals Sy 1 ^ 2 (a)ir( Q )(a)Ei, we deduce 
that there is a punctured neighbourhood of zero in Z n -\, such that for each Z, the function 
Sy 1 ^ 2 (a)ir(Q}(a)E[ — ^2k=i M(a) ki iE k vanishes on elements g — pac of G„_i (p in P n -i, a in 
Z„_i, c in G„-i(Df )) such that a is in this neighbourhood. 

In particular, there exists N a such that for every (zi, . . . , z„_i), the vector function 

<^y 2 (a)7T( )(a)_E(zi, • ■ ■ >2n-i) - t M(a)E(zi, z„_i) 
vanishes when we have |z„_i|f < QF Na - 

This implies, as in the proof of Proposition 2.6. of |C-P| . the following claim: 

Claim. There is actually an M" , such that for every z in Z n _\, with \z n ^\\p < qp M , and every 
a in Z n -\, with \a\p < 1, the function E(z\, . . . , z„_ia) is equal to 5\j 2 {a) t M{a)E{{z\ 1 . . . ,z„_i). 
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Proof of the claim. We denote (zi, . . . , z„_2) by x, and z„_i by z. 

If U is an open compact subgroup of Z u ^i{Of), such that E and the homomorphism a G Z n _i l— ^ 
-M(a) £ G q (C) are C7 invariant, we denote by iti, . ..,it s the representatives of Z n -\{D p) /U , and 
by u>, the canonical generator of Z„_i/Z„_i(Df). We put M" = maXi > j(N Ui , N u ). 
Then for z in {z G 2 n _i, |z|i? < (?^ M }, and a = ufiiiU in {z G < 1} (with u in J7, 

and r G N), we have 

E(x,za) = E(x,ZLJ r Ui) = 5 1 u /2 (u i ) t M(u i )E(x,zuj r ) 

because zu> r belongs to {z € Z n -i, \z\p < q F M } C {z G Z n -i, \z\f < Sjr^"*}- But if > 1, 
again one has 

E(x,zuj r ) = d\l^{uj) t M{u)){uj i )E{x,zu) r - 1 ), 

and zw r_1 belongs to 

{z G Z n _i, \z\ F < q F N ' 2 } C {z G Z n _x, |z| F < q F ^}, 
and repeating this step, we deduce the equality E{x, za) = S^j 2 [a) t M{a)E{x, z). □ 

Hence there is an element zq in Z n —\ with \zq\f = q F M , such that for every (zi, . . . , z n _2) 
in Z\ x ■ • • x Z n _2, the vector E(z\, . . . , z n -\) is equal to 

<S^ 2 (z I ^ 1 ) t M(z n _ 1 )(z n _ 1 )[^ 1/2 (zo) t M(z - 1 )]^(z 1 , . . . , z„_ 2 , z ) 

for any z„_i with |z„_i|f < 1- 

Hence the function 1{i z „_ 1 i<i}iS(zi, . . . , z„_i) is equal to 

(xi,.. . ,x q ) t M(z n ^ 1 )(z n ^ 1 )[S I }l /2 {z ) t M(zQ 1 )}E(z 1 , . . . , z„_ 2 , z Q )SlJ 2 (z n ^ 1 )l { \ Zn _ 1 \< 1} . 
One proves as for the function D, that function ln Zn _ 1 \ > i\(z n —i)S(zi, . . . , z„„i) is of the form 

^ S(zi, z„_ 2 , z /3 )(5^( i 2 (z„_i)S , ( 9(z n _i) 

/3 G B 

with 5/3 in C£°(F) for some finite set B. 

— 1/2 ~ 

By induction hypothesis again, applied to the function {5 U Ei)[z\, . . . , z„_2, zo) an d the func- 

1 /2 

,z n _ 2 ,z^), we deduce that the function S — l{|» n _ 1 |<i}5 + 1{| 2 „_ 1 |>i}5 is a 
sum of functions of the form rifc=i c ik,n-k{zk)$u* +1 ■ ■ ■ ^ (z k )v F (z k ) m 'i ^(z k ) for i fc between 1 
and rfc, null or positive integers or integer vectors m'l, and functions <^' fc ' in C%°(F). 
The statement follows as the function W equals D + S. □ 

3 L 2 (Z n N n \G n ) and discrete series 

First we characterise the Whittaker functions which belong to J N ^ p \W(p)\ dp in terms of 
exponents of the "shifted derivatives" (see [BJ, 7.2.). This result has been used in [M] . 
We say that a character of a F* is positive if its (complex) absolute value, is of the form | \ r F for 
some positive real r. 

Theorem 3.1. Let 6 be a nondegenerate character of the group N n , and n be a 9-generic rep- 
resentation of G n , let the ci „_fc, . . . , c rfci „_/c be the characters of Z k appearing in a composition 
series of t — 7r'"~ fc ' . Then the integral 

f \W{p)\ 2 dp 

JN n \P„ 

converges for any W in it if and only if all the characters Ci k . k &\j 2 +i are positive for k between 1 
and n — 1. 
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Proof. Again we prove the stronger statement: 

. Let (w, V) be a P n -submodule of C°° {N n \P n , 9), such that for every k between 1 and n — 1. the 
Gk-module t = 7r(™~ fc ) = , f~( < I>~) Tl ~ fc ~ 1 (7r) has a composition series such that, on each respective 
quotient, the central subgroup Zk acts by the characters c\ iTl -k, . . . ,c rktn - k . Then the integral 

f \W{p)\ 2 dp 

JN„\P„ 

converges for any W in it if and only if all the characters Ciie,k^u^ 1 are positive for k between 1 
and n — 1. 

1 /2 

Suppose first that all the characters Ci k ,k^u k 1 are positive. Let W belong to the space of tt, 
first we notice the equality 

W(p)\ 2 dp= f \W{g)\ 2 dg. 

N n \P n JN n -l\G n -i 

Now the Iwasawa decomposition reduces the convergence of this integral to that of 

\W{a)\ 2 5 N l ^(fa 

A„_i 

Using coordinates (z\, . . . , z n -\) (see Lemma II. ip of A n _i, the function Sj^ 1 (zi, . . . , z n -x) is 
equal to Uk=i( 6 u k+1 . • . <5 c/ „_ 1 )- 1 (z fc ). 

According to Theorem 12.11 the function |W(zi, . . . ,z„_i)| 2 is bounded by a sum of functions of 
the form 

n-1 

n \c ik ,k\(zk)\ci k ,k\(zj)(8 Uk+ i ...8 Un ){z k )v F (z k ) mk <j) k (z k ). 

k=l 

Hence our integral will converge if the same is true of the integrals 

/ n — 1 
J\ \ci k A( z k)\ci k ,k\o'uSzk)vF{tk) mh 4>k{zk)dz 1 . ..dz n , 
A ^-i k =i 

i.e. if the integrals j Zk \c ik ^(z k )\c lk A(z k )5 Un (zk)vF{tk) mk 4>k{t k )dz k converge for any k between 
1 and n — 1. 

But the restriction of 8fj n to Z k is equal to Su k+1 , so the convergence follows from our assertion 
on the characters c% k ,k^u • 

Conversely, suppose that every W in -Krm belongs to the space L 2 (N n \P n ) corresponding to a 
right invariant measure on N n \P n . 

By Iwasawa decomposition, one gets that J N ^ p \W{p)\ 2 dp = J N , G i |l/F(<7)| 2 <ig is equal 
to J A xF \W(ak)\ 2 6j l 1 ri i (a)d*adk which is greater than dk(U) J A i \W(a)\ 2 6^_ i (a)d*a for 
some compact open subgroup U fixing W. In particular the integral J A i \W(a)\ 2 6j f 1 _ i (a)d*a 
converges for any W in it. 

This by Fubini's theorem and smoothness of W, implies that J A |W A (a)| 2 5^ 1 _ i (a)cZ*a is finite 
for any W in tt. But the restriction of <5/v„_i to A n _\ is equal to §N n - 2 ^Un-i > so that the integral 
J A \W(a)\ 2 S'^ 1 ^Jj 1 2 (a)d*a is finite for W in n, which by Iwasawa decomposition again, 

implies that J N < p i \S u 1 ^_ 2 i W(p)\ 2 dp is finite. 

— 1/2 

The functions Sjj W belong to the space of 4>~{-n), hence by induction, all the characters 

1/2 1/2 

c ik,k$ij are positive for k < n — 2. So we only need to check that the characters Ci rl _ 1 ^ n -\5 J j 

1/2 

are positive. Suppose that one of them, c\_ rl -\o l j for instance, wasn't. 
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Then, taking v nonzero in (71") such that Z n ^\ multiplies v by ci jn _i, according to Proposition 

1/2 

I2.3l and taking W a preimage of v in tt, there is a positive integer iV a , such that S v (a)Tr(a)W(g) — 
ci tn -i(a)W(g) is zero whenever for any g in G n _i with |z(g)|^ < qp Na . As in Claim[21 this implies 

1 /2 

that there is a positive integer N, such that W(ag) is equal to £j/ (a)ci. n -i(a)W (g) whenever 
\ z {g)\F < (Tp^ and < 1. We recall that W doesn't belong to V(U n , 1) (otherwise v would 
be zero), hence according to Proposition 12.31 there is go in G„_i with |z(go)|F < Qp N , such that 
W(go) is nonzero. We denote by Wo the function n(go)W, and we recall that the integral 

W (a)\ 2 Sj^_ i (a)d*a = / \W (zi . . . ^n-i)| 2 ^_ 1 (2i • ■ ■ z n - 1 )dz 1 . . .dz n _i, 

is finite. Hence the smoothness of Wo and Fubini's theorem imply that the integral 

Wo(zn-i)| 2 <^ _ 1 (^n-l)^n-l = / |Wo(2;„_i)| 2 (iz rl _i 

1/2 

is finite. But for \z n -i\p < 1, the function Wo(z n -i) is equal to 5jj (2 n _i)ci in _i(z n _i)W(<?o) 
with W(<?o) nonzero, hence it is square integrable at zero if and only if Sjj n c 2 n _i, thus S^c% <n -i 
is positive. 

□ 

Remark 3.1. The last proof more or less contains the following fact (which is more precisely a 
consequence of an induction, and the last step of the proof): 

For every character Ci k}Tl -k appearing in a factor series of ir( n ~ k \ there is W in V, such that 
W(zk) is equal to [cj fe! „_ kS^/^ ■ ■ ■ $\j^]{zk) near zero. Hence this family of characters is minimal 
in the sense that each of them must occur in the expansion given in Proposition 12.11 of some W 
in V. 

From this we deduce a characterization of the Whittaker functions in L 2 (Z n N n \G n ). 

Corollary 3.1. Let 9 be a nondegenerate character of the group N n , and it be a 9 -generic repre- 
sentation ofG n with unitary central character, let the c\^ n -k, ■ ■ ■ t c rktn —k be the central characters 
appearing in the factor series of t — n( n ~ k ) . Then the integral 

[ \W(g)\ 2 dg 

JZ n N n \G n 

converges for any W in tt if and only if all the characters Ci fe! & are positive for k between 1 and 
n — 1 . 

Proof. By the Iwasawa decomposition, the integral J z N ^ G \W(g)\ 2 dg converges for every W 
in W{ir, 9) if and only if the J A \W '(a)\ 2 '5^ (a)dg converges for every W in W(n,6). 
As the character Sn„ restricts to G n _i as <5jv„_i£[/„ , this integral is equal to 

\5-l /2 W{a)\H N l t {a)dg. 

A n -y 

But this integral converges for any W in W(tt, 9) if and only if so does the integral 

\S^ /2 W( P )\ 2 dp 

N n \P n 

for any W in W(n, 9). 

By the statement in the proof of theorem 13.11 applied to 5 U ' ® tt', this is the case if and only 
all the characters Ci k .k are positive for k between 1 and n — 1. 

□ 
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Let P be a standard proper parabolic subgroup of G„, U its unipotent radical, and M its 
standard Levi subgroup. If (tt, V) is a smooth irreducible representation of G n , one calls cuspidal 
exponent of tt with respect to P, a character \ of the center of M such that the characteristic space 
of the Jacquet module (V(/) Xj00 is nonzero. Denoting by A the set of simple roots {cxi, . . . , a n } of 
G n , We denote by p{*i>—'*'} the standard parabolic subgroup associated with the set of positive 
roots A — {cti i: . . . ,ai t }, by {/{ , i>— its unipotent radical, by M^ 1 ''"' 2 '} its standard Levi 
subgroup, which admits as a central subgroup the product . . . Zi t . 

Notice that except for case D, for {i\, . . . ,i t } = {2}, where we used the notation f7a,n— 2 for U^- 1 ' 2 ^, 
the group U {k} is what we already denoted by Uk t n-k before. 
We denote by Aj ■ the set 

{z n . . . z it £ Z h ... Z it , \z ik \ F < 1, and 1^ . . . z H \ F < 1}. 

Theorem 4.4.6 of [C] then asserts that tt with unitary central character is a discrete series 
representation if and only if, for every standard parabolic subgroup p{*i> , "i**} ) if ^ is a cuspidal 
exponent of tt with respect to F'' 1,, "' , ^ ) the restriction of \ to A~ j is less than 1, or equiva- 
lently if \ restricted to Z^ x . . . Zi t is positive. 

We also notice that for any k, the Jacquet module Vjj{i k } surjects onto 7(j{i lr ..,i,} , and that the 
character djj{i 1: ...,i t } restricts to Zi k as 6jj{i k } , hence if % is a cuspidal exponent of tt with respect 
to pW'—M . then x\z ih is the restriction to Zi k of a cuspidal exponent of 7r with respect to P^ k \ 
This implies that 7r irreducible with unitary central character is a discrete series representation if 
and only if the cuspidal exponents of tt with respect to maximal parabolic subgroups pf Jfc } have 
positive restriction to Zi k . 

We call a character x of such that (V tyn ~ k ^ l ) x (or equivalently (V A ^"~ fc - ) ) X!00 ) is nonzero an 
exponent of the derivative (7T^ n_ ^ , y( n ~ fe )). Now we recall that we showed in Proposition 12.71 
that the Z^ modules Vu k n _ k and y( n-fe ) have the same nonzero weight subspaces. This allows 
to prove in our four cases the following conjecture of Lapid and Mao ([L-MJ, conjecture 3.5). 

Theorem 3.2. Let tt be a generic representation of G n with unitary central character and with 
Whittaker model W(tt, 6), then the following statements are equivalent: 

i) The integral 

! \W{g)\ 2 dg 

JN n Z n \G n 

converges for any W in W(tt, 9). 

ii) All the exponents of the derivatives of tt are positive. 
Hi) the representation tt is square-integrable. 

Proof. By assumption, the exponents of the derivatives of tt are the characters Ci k ^ of corollary 
13.11 hence i) ^ ii) is corollary 13. II 

ii) hi): we treat the case D separately, so assume first that G n is not GSO(2(n — 1),F). 
By Proposition 12.61 every cuspidal exponent of tt corresponding to Vfj{k} is positive if and only 
if every exponent of the derivative positive. But we have already seen that this implies 

that tt is a discrete series representation. 

For the case D, we could have reversed the roles of the roots a± and ct2 (which correspond to 
the two symmetric roots at the end of the Dynkin diagram). The only effect it would have is 
to change the definition of the derivative functors 7r(™ -2 ) and 7r(™ _1 ). Indeed U2 would become 
U a2 , Z\ and Zi would be exchanged. The character 83 would have to be trivial on U a2 instead 
of being trivial on U ai ■ But i) and ii) would still be equivalent in this case, and i) is independent 
of these choices. 

In both cases, the maps Ik from Vu k n _ k to y( n ~ fe ) take nonzero weight subspaces to nonzero 
weight subspaces. For n > 3, the space Vjj k n _ h is equal to Vyik} . In the first case, Vjj 1 n _ t is 
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equal to Vtj{i} = Vjj ai , and it is equal to Vjj{2} — Vjj a2 in the second case. This implies that all 
the exponents of the derivatives of n are positive if and only if all cuspidal exponents of 7r with 
respect to maximal parabolic subgroups are positive. Again this proves ii) <^> iii). □ 
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